A Q-learning approach to automated unmanned air vehicle demining

نویسندگان

  • Silvia Ferrari
  • Greyson Daugherty
چکیده

This paper develops a novel Q-learning approach to unmanned aerial vehicle (UAV) navigation, or path planning, for sensing applications in which an infrared (IR) sensor or camera is installed onboard the UAV for the purpose of detecting and classifying multiple, stationary ground targets. The main advantage of this approach over existing path planning techniques is that the optimal guidance policy is learned via the Q-function, without explicit knowledge of the system models and environmental conditions. As a result, the onboard guidance algorithm can adapt to different sensors, vehicle dynamics, and environmental conditions, without designer intervention, and without the need for accurate modeling of every system component. The approach is demonstrated through a demining application in which a UAV-based IR sensor is capable of determining the optimal altitude for properly detecting and classifying targets buried in a complex region of interest.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Q-Learning Approach to Automated Unmanned Air Vehicle (UAV) Demining

This paper develops a Q-learning approach to Unmanned Air Vehicle (UAV) navigation, or path planning, for sensing applications in which an infrared (IR) sensor or camera is installed onboard the UAV for the purpose of detecting and classifying multiple, stationary ground targets. The problem can be considered as a geometric sensor-path planning problem, because the geometry and position of the ...

متن کامل

Trim and Maneuverability Analysis Using a New Constrained PSO Approach of a UAV

Performance characteristic of an Unmanned Air Vehicle (UAV) is investigated using a newly developed heuristic approach. Almost all flight phases of any air vehicle can be categorized into trim and maneuvering flights. In this paper, a new envelope called trim-ability envelope, is introduced and sketched within the conventional flight envelope for a small UAV. Optimal maneuverability of the inte...

متن کامل

A Biologically Based Chemo-Sensing UAV for Humanitarian Demining

Antipersonnel mines, weapons of cheap manufacture but lethal effect, have a high impact on the population even decades after the conflicts have finished. Here we investigate the use of a chemo-sensing Unmanned Aerial Vehicle (cUAV) for demining tasks. We developed a blimp based UAV that is equipped with a broadly tuned metal-thin oxide chemo-sensor. A number of chemical mapping strategies were ...

متن کامل

Unmanned Air System Search and Localization Guidance Using Reinforcement Learning

Requirments for current and future Unmanned Air Vehicles with longer ight endurances have led to a need for an autonomous soaring capability. This paper investigates aircraft ight path guidance for search and localization of Regions of Interest, consisting of atmospheric phenomena. The problem is posed as an o ine agent learning problem, of localizing atmospheric thermal locations and then guid...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012